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Abstract 


Results  are  given  for  stabilizing  time  varying  discrete  linear  systems 

by  means  of  a feedback  control  stemming  from  a receding  horizon  concept 

ctnd  a minimum  quadratic  cost  with  a fixed  terminal  constraint . The  results 

parallel  those  recently  obtained  for  continuous  time  systems  [8]  and  extend 

a well  known  method  of  Kleinman  for  stabilizing  discrete  fixed  linear  systems  [7]. 
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I . Introduction 


Consider  a completely  uniformly  controllable  and  observable  linear  time 
varying  discrete  system 

X.  , = If.  X.  + B,  u.  (1) 

1+1  11  11 

y.  = C.  X.  (2) 


1 1 


where  x^cR"  is  the  state  vector,  ) are  given  nxn,  nxm  and  pxn  time 


varying  matrices,  and  the  state  transition  matrix  t>^  is  assumed  to  be  non- 
singular for  all  i.  There  are  very  few  methods  for  constructing  a stabiliz- 


ing feedback  control,  u^^  = L^x^,  in  the  time  varying  case,  the  most  familiar 


of  which  is  the  steady  state  optimal  control  for  the  quadratic  cost 


J = lim  y ylQ.y.  + uIR.u. 

. . . Ill  111 


(3) 


i,'+«'  1=1 
f o 


where  ^ 0 and  > 0 [1-3].  Control  laws  based  on  a receding  horizon  no- 


tion in  minimizing  control  energy  subject  to  a moving  terminal  constraint 
have  been  developed  by  Thomas  [4,5]  in  the  case  of  time  invariant  systems. 
These  controls  add  new  insight  into  a method  for  stabilizing  a fixed  linear 
system  due  to  Kleinman  [6,7].  Recently,  a generalization  of  the  control 
law  based  on  a receding  horizon  notion  has  been  reported  in  [8].  In  addition 
to  the  extension  to  time  varying  systems,  this  generalization  includes  the 
possibility  of  weighting  the  state  vector  through  a nonnegative  weighting 
matrix  Q(t)  which  is  analogous  to  the  Qj,  matrix  in  (3).  The  purpose  of  thisp 


note  is  to  indicate  the  parallel  nature  of  these  results  for  time  varying  Section 

Buff  Section  □ 
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discrete  systems  and  to  point  out  the  advantage  in  computing  the  gain  matrix 
for  this  control  law  in  relation  to  the  steady  state  control  for  (3). 
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II.  Main  Result 

We  consider  a feedback  control  law  for  the  time  varying  system  (1)  - (2) 
which  can  be  interpreted  as  optimal  for  the  "receding  horizon"  quadratic  cost 

i+N-1 


subject  to  the  moving  terminal  constraint 

’'i+N  ' 

When  a non-null  weighting  matrix  Qj^  is  chosen  in  (4),  we  assume  that  it  is 
represented  by  for  appropriately  chosen  matrix  Dj^.  The  optimal 

control  for  (4)  - (5)  can  be  determined  using  standard  minimization  techni- 
ques with  a Lagrange  multiplier  to  handle  (5).  Assuming  the  fixed  horizon 
length  N in  (4)  is  chosen  sufficiently  long,  the  feedback  form  of  this 
control  can  be  expressed  in  the  following  way 

u.  = -RT^B:P“^(i+l,i+l+N)4>.x.  (6) 

1 11  11 

where  the  inverse  of  the  double  indexed  P ^ matrix  is  defined  implicitly 
through  the  solution  to  the  discrete  time  Riccati  type  equation 


P(k,j)  = ♦C^P(l<+l,j)»^‘^-*‘^P(k+l,j)*;‘^c;D;[I 


k k k" 


+ D^C,^*‘^P(k+l,j)*^"^C^D^]‘^  D^C^$"^P(k+l,j)*^‘ 


P(j,j)  = 0. 


The  nxn  symmetric  matrix  P(i+l,i+l+N)  is  obtained  by  summing  (7)  backward 
from  k = i+l+N  to  k = i+1  for  any  given  j = i+l+N.  Although  the  control 
law  (6)  - (7)  is  obtained  by  summing  a Riccati  equation  over  a finite  time 
interval  (in  contrast  with  the  infinite  time  summation  interval  required 
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for  the  minimum  solution  of  the  steady  state  quadratic  cost  (3)),  it  is 
asserted  here  that  this  control  renders  the  feedback  system  (1)  asymptoti- 
cally stable  under  appropriate  controllability  and  observability  conditions. 
The  following  theorem  is  the  discrete  time  analog  of  Theorem  2.1  in  [8]. 


The  integers  Z and  Z in  the  statement  of  this  theorem  pertain  to  the 
c o 


uniform  bounds  on  the  controllability  and  observability  Gramians  in  that 


complete  uniform  controllability  of  the  pair  implies  the  existence 


of  a fixed  integer  Z^  such  that 


i+£  -1 

a I J p «(i,k+l)B  B'$'(i,k+1)  $ a„I 

X « • K iC  ^ 

k=i 


i-1 


♦ (i.j)  A n 4>, 

• jC 

=1 


1 


for  all  i and  for  some  positive  scalars  (02^,02^'  integer  Z^  is  similarly 

defined  using  the  complete  uniform  observability  of  the  pair  ($^,0^). 

Theorem  (1)  Assume  that  R.  and  Q,  satisfy  a., I $ R.  $ a,. I and  0 $ Q.  $ a^I 

1 jL  o 1 *t  Id 

for  positive  scalars  (a-,a,.  ,0.)  and  for  all  i.  Under  the  conditions  that 
the  pair  (*^,8^)  is  uniformly  completely  controllable  and  is  bounded  such 
that  I |c|  I $ Oy  for  all  i,  the  system  (1)  - (2)  with  feedback  control  ('j) 
is  uniformly  asymptotically  stable  when  the  horizon  length  N is  chosen  to  satisfy 
£^+l  $ N < •».  (Note:  and  can  be  identically  zero.) 

(2)  Suppose  R.  and  Q.  satisfy  a.I  $ R.  S o I and  a^I  $ Q.  $ a.I  for 
positive  scalars  (a,,a^,ac,a  ) and  for  all  i.  Under  the  conditions  that  the 

O 4 0 D 


pairs  (*^,8^)  and  (<>.,C^)  are  completely  uniformly  controllable  and  observable, 
the  system  (1)  - (2)  with  feedback  control  (6)  is  uniformly  asymptotically 
stable  when  the  horizon  length  N is  chosen  to  satisfy:  1 + max(£  ,£  ) $ N 5 «. 


Proof  Outline;  The  proof  parallels  that  given  in  [8]  for  continuous  time 


systems  in  that  consideration  is  given  to  the  adjoint  system  of  (1)  with 
control  ( 6 ) , viz • 


’'i+l 


[4>.  - B.R7^B:p‘^(i+l,i+l+N)<l>.]'"^  X. 

X XXI  X.  X 


(8) 


A F!x. 
^11 


together  with  the  associated  scalar  valued  function 

V(x,i)  = x’<I>“^P(i+l,i+l+N)4.|"^x.  (9) 

Similar  to  the  approach  in  [8],  the  feedback  system  (1)  and  (6)  will  be  asymp- 
totically stable  if  and  only  if  the  adjoint  system  (8)  is  asymptotically  un- 
stable. The  main  difference  between  the  continuous  time  proof  in  [8]  and  the 
proof  of  the  above  Theorem  is  the  judicious  choice  in  Lyapunov  function  (9) 
for  the  discrete  time  case.  Using  a detailed  analysis  w.  Lch  can  be  found  in 
the  complete  report  [9],  it  can  be  shoim  that  V(x,i)  in  (9)  is  uniformly 
bounded  cibove  and  below  by  positive  scalars  (og.Og)  such  that  Ogl |x| | $ V(x,i) 
^ ag||x|l  for  all  i.  This  involves  establishing  uniform  lower  and  upper 
bounds  on  the  matrix  P(i,i+N).  Next,  it  can  be  shown  that  the  difference 
{V(x.^^,i+1)  - V(x^,i)}  is  nondecreasing  along  solutions  of  (8)  and,  more 
importantly,  is  uniformly  bounded  below  in  the  sense  that  there  exists  a posi- 
tive scalar  so  that 

V(Xi^l,i+l)  - V(x^  ,i^)  i a^ollx^  M 

o o 

for  all  i 5 under  the  hypothesis  of  the  theorem.  This  inequality  hinges 

on  establishing  the  property  of  the  matrix  solution  to  (7)  that  P(k,jj^) 

$ P(k,j2)  for  k $ jj^  $ jj,  and  the  property  P ^(k,jj^)  i P ^(k,j2)  when 
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k < ji  $ j2  for  a related  matrix  P ^{k , j )4K(k , j ) which  is  defined  implicitly 


by  the  solution  to 


K(k,j)  = $^K(k+l,j)$^  - <Jj^K(k+l,j)Bj^[!^ 

+ Bj^K(k+l,j)B^]'^B^K(k+l,j)4>^  + 

with  the  boundary  condition  K(j,j)  =0.  As  pointed  out  in  [9],  the  matrix 
K(k,j)  is  the  same  Ricatti  gain  matrix  which  appears  in  the  solution  to  the 
standard  discrete  regulator  problem  (without  an  end  point  constraint).  This 
fact  leads  to  a relation  between  the  control  (6)  and  the  standard  regulator 
control  in  that  it  is  possible  to  establish  the  following  inequalities 
(details  presented  in  [9]): 

i +N-1 

x'K(i  ,i  +N)x  $ y y^Q,  y,  + u'R,u,  ^ x'P”'^(i  ,i  +N)x 
o o o o k k-^k  k k k o o o o 

k=i 

o 

where  Uj^  is  presumed  specified  by  (6).  This  shows  that  the  control  (6)  tends 
to  the  same  control  as  the  steady  state  quadratic  cost  (3)  when  the  horizon 
length  N •*  since  (6)  is  an  asymptotically  stable  control  and  P"^(k,j)  = 
K(k,j).  Thus  in  this  sense  the  control  (6)  can  be  interpreted  as  an 
approximation  to  the  standard  linear  quadratic  cost  problem  (3)  which  has  the 
property  that  its  underlying  Riccati  equation  is  summed  over  a finite  time 
interval  while  still  guaranteeing  asymptotic  stability. 

III.  Concluding  Remarks 

1.  In  the  case  of  a time  invariant  system  and  constant  weighting  matrices, 
i.e.  ( ♦,BiC,Q=D'D,R)  all  constant,  the  control  (6)  reduces  to 

u.  = -R‘^B'P‘^(N)«x,  (10) 
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where  P{N)  can  be  obtained  from 

P(k+1)  = - ♦■S(k)*'"^C'D’[I 

+ DC4)"^P(k)<l'’"^C'D']~^DC4>“^P(k)4>’'^ 
+ , P(o)  = 0 . 


(11) 


? 

I 

I 

I 

t 

i 

I 
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This  control  includes  the  results  of  [5]  and  [7]  as  special  cases  by  choosing 
Q=0,  or  C=0;  viz,  (11)  can  be  summed  in  closed  form  as 

N-1  , 

P(N)  = I BR‘  B'^'"  (12) 

k=o 


which  coincides  with  the  gain  matrices  of  [5]  and  [7].  In  [10]  it  is  shown 

that  the  matrix  it  in  (12)  can  be  singular  for  a controllable  single  input 

system,  while  still  facilitating  a stabilizing  feedback  control  law. 

2.  Other  results  which  parallel  the  continuous  time  version  in  [8]  are: 

(i)  The  degree  of  relative  stabilization  of  the  control  (6)  can  be  guaranteed 

in  the  sense  that  I lx, ! I -►  0 as  least  as  fast  as  (— )^  as  i « for  a chosen 
' ' 1 ’ ' a 

o > 1,  provided  the  matrix  in  (7)  is  replaced  by  a<I>j^  for  all  k.  (ii)  The 

dual  problem  in  filtering  theory  for  the  fixed  terminal  minimum  energy  prob- 

lem, (4)  - (5),  is  the  standard  linear  filter  which  yields  minimum  error 
covariance  at  time  i with  a completely  unknown  moving  initial  condition  at 
time  (i-N).  These  results  together  with  the  rigorous  proof  of  the  Main  Result 
are  contained  in  [9]. 

3.  As  in  the  continuous  time  version  [8],  the  proof  for  the  main  result 
has  been  rather  indirect  involving  the  adjoint  system  (8)  and  a suitable 
Lyapunov  function.  However,  a direct  proof  in  the  time  invariant  case  can 

be  obtained  (as  in  the  time  invariant  case  in  [8])  using  the  Lyapunov  function 
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